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WHAT IS CLAIMED IS : 

1 . A motion controlled handheld device comprising: 

a display having a viewable surface and operable to generate an image; 

a gesture database maintaining a plurality of gestures, each gesture defined by 
5 a motion of the device with respect to a first position of the device; 

a plurality of applications each having a plurality of predefined commands; 

a gesture mapping database comprising a plurality of command maps, each of 
the command maps corresponding to a particular one of the applications and mapping 
each of the predefined commands to one of the gestures; 
10 a motion detection module operable to detect motion of the handheld device 

within three dimensions and to identify components of the motion in relation to the 
viewable surface; 

a control module operable to load one of the applications, to select one of the 
command maps corresponding to the loaded application, to track movement of the 
15 handheld device using the motion detection module, to compare the tracked 
movement against the gestures to determine a matching gesture, to identify, using the 
selected command map, the predefined command mapped to the matching gesture, 
and to perform the identified command using the loaded application. 

20 2. The motion controlled handheld device of Claim 1, wherein the control 

module is further operable to load a second one of the applications, to select a second 
one of the command maps corresponding to the second loaded application, and to 
replace the first selected command map with the second selected command map. 

25 3. The motion controlled handheld device of Claim 2, wherein the 

matching gesture maps to a first predefined command using the first selected 
command map and to a second predefined command using the second selected 
command map. 
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4. The motion controlled handheld device of Claim 1, wherein: 

a selected one of the applications has a first application state and a second 

application state; and 

the command map associated with the selected application comprises a first 
5 mapping for the first application state and a second mapping for the second 

application state, the first mapping and the second mapping each mapping selected 

ones of the gestures to selected ones of the predefined commands of the selected 

application. 

10 5. The motion controlled handheld device of Claim 4, wherein the first 

application state is associated with a first image type and the second application state 
is associated with a second image type. 

6. The motion controlled handheld device of Claim 4, wherein the first 
15 application state comprises viewing of a portion of an image of application data, and 
the second application state comprises viewing a hierarchical menu for performing 
operations with respect to the application data. 
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7. The motion controlled handheld device of Claim 1, further comprising: 

a first accelerometer operable to detect acceleration along a first axis; 

a second accelerometer operable to detect acceleration along a second axis, the 
second axis perpendicular to the first axis; and 

a third accelerometer operable to detect acceleration along a third axis, the 
third axis perpendicular to the first axis and perpendicular to the second axis; and 
wherein: 

the gesture database further defines each of the gestures using a sequence of 
accelerations; 

the motion detection module is further operable to detect motion of the device 
using accelerations measured by the first accelerometer, the second accelerometer, 
and the third accelerometer; and 

the control module is further operable to match the accelerations measured by 
the motion detection module against gesture definitions in the gesture database to 
identify particular ones of the gestures. 
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8. A method for controlling a handheld device comprising: 
generating an image on a viewable surface of the handheld device; 
maintaining a gesture database comprising a plurality of gestures, each gesture 

defined by a motion of the device with respect to a first position of the device; 

maintaining a plurality of applications each having a plurality of predefined 
commands; 

maintaining a gesture mapping database comprising a plurality of command 
maps, each of the command maps corresponding to a particular one of the 
applications and mapping each of the predefined commands to one of the gestures; 

loading one of the applications; 

selecting one of the command maps corresponding to the loaded application; 

tracking movement of the handheld device using the motion detection module 
in relation to the viewable surface; 

comparing the tracked movement against the gestures to determine a matching 
gesture; 

identifying, using the selected command map, the predefined command 
mapped to the matching gesture; and 

performing the identified command using the loaded application. 

9. The method of Claim 8, further comprising, in response to a received 
command: 

loading a second one of the applications; 

selecting a second one of the command maps corresponding to the second 
loaded application; and 

replacing the first selected command map with the second selected command 

map. 

10. The method of Claim 9, wherein the matching gesture maps to a first 
predefined command using the first selected command map and to a second 
predefined command using the second selected command map. 
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1 1 . The method of Claim 8, wherein: 

a selected one of the applications has a first application state and a second 
application state; and 

the command map associated with the selected application comprises a first 
5 mapping for the first application state and a second mapping for the second 
application state, the first mapping and the second mapping each mapping selected 
ones of the gestures to selected ones of the predefined commands of the selected 
application. 

10 12. The method of Claim 11, wherein the first application state is 

associated with a first image type and the second application state is associated with a 
second image type. 

13. The method of Claim 1 1, wherein the first application state comprises 
15 viewing of a portion of an image of application data, and the second application state 
comprises viewing a hierarchical menu for performing operations with respect to the 
application data. 



14. The method of Claim 8, wherein the gesture database further defines 
20 each of the gestures using a sequence of accelerations; the method further comprising: 
detecting acceleration along a first axis; 

detecting acceleration along a second axis, the second axis perpendicular to 
the first axis; and 

detecting acceleration along a third axis, the third axis perpendicular to the 
25 first axis and perpendicular to the second axis; 

detecting motion of the device using accelerations measured by the first 
accelerometer, the second accelerometer, and the third accelerometer; and 

matching the accelerations against gesture definitions in the gesture database 
to identify potential indicated ones of the gestures. 



30 
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15. Logic for controlling a handheld device, the logic embodied in a 
computer readable medium and operable when executed to perform the steps of: 

generating an image on a viewable surface of the handheld device; 
maintaining a gesture database comprising a plurality of gestures, each gesture 
5 defined by a motion of the device with respect to a first position of the device; 

maintaining a plurality of applications each having a plurality of predefined 
commands; 

maintaining a gesture mapping database comprising a plurality of command 
maps, each of the command maps corresponding to a particular one of the 
10 applications and mapping each of the predefined commands to one of the gestures; 
loading one of the applications; 

selecting one of the command maps corresponding to the loaded application; 
tracking movement of the handheld device using the motion detection module 
in relation to the viewable surface; 
15 comparing the tracked movement against the gestures to determine a matching 

gesture; 

identifying, using the selected command map, the predefined command 
mapped to the matching gesture; 

performing the identified command using the loaded application. 

20 

16. The logic of Claim 15, further operable, in response to a received 
command, to: 

load a second one of the applications; 

select a second one of the command maps corresponding to the second loaded 
25 application; and 

replace the first selected command map with the second selected command 

map. 



17. The logic of Claim 16, wherein the matching gesture maps to a first 
30 predefined command using the first selected command map and to a second 
predefined command using the second selected command map. 
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18. The logic of Claim 15, wherein: 

a selected one of the applications has a first application state and a second 
application state; and 

the command map associated with the selected application comprises a first 
5 mapping for the first application state and a second mapping for the second 
application state, the first mapping and the second mapping each mapping selected 
ones of the gestures to selected ones of the predefined commands of the selected 
application. 

10 19. The logic of Claim 18, wherein the first application state is associated 

with a first image type and the second application state is associated with a second 
image type. 

20. The logic of Claim 15, wherein the gesture database further defines 
15 each of the gestures using a sequence of accelerations; the logic further operable when 
executed to perform the steps of: 

detecting acceleration along a first axis; 

detecting acceleration along a second axis, the second axis perpendicular to 
the first axis; and 

20 detecting acceleration along a third axis, the third axis perpendicular to the 

first axis and perpendicular to the second axis; 

detecting motion of the device using accelerations measured by the first 
accelerometer, the second accelerometer, and the third accelerometer; and 

matching the accelerations against gesture definitions in the gesture database 
25 to identify potential indicated ones of the gestures. 
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21. A motion controlled handheld device comprising: 
means for generating an image on a viewable surface of the handheld device; 
means for maintaining a gesture database comprising a plurality of gestures, 
each gesture defined by a motion of the device with respect to a first position of the 
5 device; 

means for maintaining a plurality of applications each having a plurality of 
predefined commands; 

means for maintaining a gesture mapping database comprising a plurality of 
command maps, each of the command maps corresponding to a particular one of the 
10 applications and mapping each of the predefined commands to one of the gestures; 

means for loading one of the applications; 

means for selecting one of the command maps corresponding to the loaded 
application; 

means for tracking movement of the handheld device using the motion 
15 detection module in relation to the viewable surface; 

means for comparing the tracked movement against the gestures to determine 
a matching gesture; 

means for identifying, using the selected command map, the predefined 
command mapped to the matching gesture; 
20 means for performing the identified command using the loaded application. 



